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Abstract 

The focus of this work is on PIN entering utilising the blinking approach, 
for user authentication and security, personal identification numbers are 
employed. PIN-based password verification users must input a physical PIN 
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Keywords a that can be cracked or hacked using shoulder surfing PIN entry process using 
oa peas a eye blinks entering does not provide or easily leave any footprints behind, mak- 


ing it a more secure password entry option. Locating the blinks of an eye over 
creating picture frames in a consecutive order the Personal identification num- 
ber is referred to as eye blinks-based authentication. This research shows how 
to resist shoulder surfing and thermal tracking attacks in real time. Today’s 
authentication technologies, such as passwords, fingerprint scanners, and PIN 
entry, are all based on one-time, static authentication mechanisms that are 
vulnerable to assaults. The Real-time eye monitoring and password authenti- 
cation methods are being used has a greater chance of being reliable, In this 
case, the system for Eye Detection and Tracking must be secure and limited. 


Convolutional neural net- 
works; 
Detection 


ing through shoulder surfing or thermal monitor- 
ing. Personal identification number authentication 
using personal identity number physical entry pro- 
cess based on sight, on the other hand, we will 
not physical traces left at any places, and thus pro- 
vide a stronger password entering option. Gaze type 
authentication is a process of locating the eye across 
many visual tracking the eye centre over time. The 
project uses a smart camera to demonstrate a real- 
time eye blinking technology to enter the password, 
as well as eye recognition and tracking for PIN iden- 
tification (Mehrube and Nguyen). 


1. Introduction 


Online system has now become an integral part of 
our daily lives, with all services moving online. 
We have grown regular repetition to various risky 
tasks, like purchasing with credit cards, email 
check/compose, internet banking, and so on, in addi- 
tion to reading the news, hunting for information, 
and other duties that are not dangerous. We are 
putting ourselves at risk while appreciating its bene- 
fits (Mock et al.) (Bhavyashree, Thriveni, and Venu- 
gopal). 

For user authentication and security, personal 


identification numbers are commonly utilised. PIN- 
based pent authentication users are required to phys- 
ically enter the PIN, exposing it to sword crack- 


OPEN ACCESS 


Authentication methods are frequently presented 
to people and must use conventional means of 
authentication knowledge-based approaches such as 
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entering passwords, hence one of the safety mea- 
sures requirements it is recommended that general 
terminal authentication methods be implemented 
simple, quick, and secure. These methods however, 
are insecure because hostile observe can observe 
them who utilise observation like shoulder-surfing 
(observing a user while password on the keyboard) 
to acquire user authentication data. There are also 
issues with security as a result of bad relation- 
ships between users and systems. As per the result 
obtained, people who are working for it has devised 
a to defend yourself, use a three-layered security 
system. PIN numbers, in which the password is 
entered by blinking their eyes at to relevant symbols 
in write order, making them immune to shoulder 
surfing (Das et al.) (Buddesab, Thriveni, and Venu- 


gopal). 
2. Literature View 


Eye Pass Shapes enhances and advances two authen- 
tication systems, Pass Shapes and Eye PIN, by 
merging them, as Alexander, Martin, and Heinrich 
(2009) propose (e-ISSN: 2395-0056 ) ’Eye-Pass 
Shapes Method.” Users in Pass Shape must paint 
shapes in a specific order; this method improves 
security but not memorability when compared to 
password entry. Eye based PIN security is given 
precedence above usability (Mustafa and Syed). 


CGP improvements, presented by Alain, Sonia, 
and Robert (2010), can be thought of a method of 
defending against graphical passwords such attacks 
using Instead of mouse clicks, eye-gaze pass-word 
input is used, but it necessitates particular ways 
for enhancing gaze accuracy. Two breakthroughs 
were presented in this work: a nearest-neighbor 
gaze-point aggregation method and one-point cali- 
bration prior to entering the pass-word. They came 
to the conclusion that the adjustments significantly 
improved the precision of users’ sight and the effi- 
ciency of the system. 


Eye Pupil Movement Based PIN Authentication 
System Design and Implementation was developed 
in 2020 by Indrajit Das, Ria Das (ISSN No. 0976- 
5697) etc. The detection of whether an eye is open 
or closed is successful 92.51% of the time, while 
the accuracy of the eye detection method is 98%. 
Finally, the work’s contribution is detailed, and a 
comparison of the created system with classic gaze, 
touch, eye movement, and gaze use of CAPTCHA 
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and graphical image-based authentication methods 
is being pursued (Mehrubeoglu and Nguyen). 


“Realtime Eye Tracking for Password Authen- 
tication” which was developed in 2020 by Asha 
Rani K P, Asha K N (ISSN: 2278-0181) (Mehrube 
and Nguyen). The excellent accuracy of the results 
stated in the preceding section, the system’s relia- 
bility has been demonstrated. The system functions 
exceptionally well in severe lighting settings (i.e., 
when lights turned off, leaving only the computer’s 
screen as a source of light, and a bulb which used to 
provide vedio), according to the trials. In these cir- 
cumstances, the accuracy percentages were similar 
to those obtained under normal lighting. 


Password Authentication via Eye Tracking Using 
Gaze Pin Entry Mrs. Pavitra S R and Mrs. Push- 
palatha S created Eye Tracking with Gaze Pin Entry 
for Password Authentication in the year 2020 (ISSN: 
2278-0181). Because of the ease of access to pro- 
cessing and equipment assets, as well as the expand- 
ing demand for human PC collaboration techniques, 
eye stare estimation is an interdisciplinary topic 
of new work that has piqued the interest of aca- 
demic, modern, and general client networks in 
recent decades (Rahman et al.) (Pushya). 


3. Proposed work 


The graphic below depicts the exact operation of the 
proposed system’s password authentication model. 
Recognizing the face is the first step in the execu- 
tion. The only way to detect blinking and analyses 
blink duration is to look at the correlation scores col- 
lected from the user’s eye’s online template during 
the previous stage’s tracking. The likeness of the 
user’s eye to the open eye template reduces when 
the user’s eye closes throughout the blinking pro- 
cess. When the blinking ceases, the user’s perspec- 
tive completely opens over, it regains its likeness to 
the template. The correlation values given by the 
template matching technique correspond exactly to 
the decrease and rise in similarity as shown in Fig- 
ure 1. 


It initially started with registration phase in which 
registration of individual should register. While 
registration person should choose a id number and 
create own password. Then it is passed to train- 
ing phase where it is completely trained by HAAR 
cascade algorithm. Then after training phase and 
system will identify the user id and password by 


No 
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Recognize Eye 


Capture Eye blinks 


Generate PIN 


Authenticate User Discard User 


FIGURE 1. Proposed Work flow chart diagram 


LBPHilocal pattern histogram algorithm). Then 
individual should blink eyes and try to enter the 
password and in the later state it will check the 
database if the database matches then there will 
transaction process. Eye tracking, also known as eye 
gaze tracking, is a method of recognizing the posi- 
tion of the eyes using video record outlines. The 
eye’s development in relation to the head may have 
a few effects as well. This technique can help handi- 
capped people talk by using deliberate motions such 
as facial, eye, and nose development. Users with 
minor disabilities may also benefit from PC access 
to commonplace activities such as playing games 
and surfing the internet. Eye tracking technology 
is used, which uses a simple web camera to watch 
a person’s eye movement and changes the cursor as 
needed. 


BANK BUDDY 


FIGURE 2. Login page 
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FIGURE 3. System identifying user id and name 


4. Implementation environment 
4.1. Machine Learning 


Machine learning is a branch of computer science 
that studies and develops methods for ’learning,’ 
or using data to improve performance on a set of 
tasks. It is regarded as a part of artificial intelli- 
gence. Machine learning is significant because it 
allows businesses to see trends in customer behavior 
and company processes, as well as aid of develop- 
ing best goods. Machine learning is the best tool for 
the success of many companies, like Uber, Google 
and Facebook. For many firms, machine learning is 
the key to success (Masini et al.) (Burés, Jordi, and 
Larrosa). 


4.2. HAAR cascade algorithm 


It’s a real-time Object Detection Algorithm that 
detects faces in images and movies. Viola and 
Jones proposed edge or line detection features in 
their 2001 study ”Rapid Object Detection using a 
Boosted Cascade of Simple Features” (Viola, Paul, 
and Jones). A big number of positive photos with 
faces and a large number of negative shots with 
no faces are provided to the algorithm to train on. 
There are four stages to the HAAR cascade algo- 
rithm (Phuc et al.): 

1. HAAR feature selection. 

2. Creating integral image. 

3. Adaboost training. 

4. Cascading classifiers. 

The Figure 4 shows creating integral image 
where eye are tested horizontally, vertically, side- 
ways etc. And cascading classifier identifies posi- 
tive and negative images and differentiates both and 
could be represented in Figure 5. 
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FIGURE 4. Creating integral image 
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FIGURE 5. Cascading classifiers representation 


4.3. LBPH(Local Pattern Histogram Algorithm 
The most frequent method (Chinimilli et al.) CK. C. 
Paul and Aslan), however, is to extract LBPH code 
from each 3*3 window in the image. We need the 
central pixel value and the neighbour pixel value 
to calculate the lbp code. Consider the following 
example: -82 is the value of the central pixel. Pixel 
values of neighbours: 137,135,115... and is given in 
Figure 6. 


ante 
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FIGURE 6. LBPH working process 


4.4. AdaBoost Algorithm 


In 1997, Freund and Schapire have proposed boost- 
ing as an ensemble modeling technique, and until 
now it has been one of the popular methods to solve 
binary classification issues (Ying). It has turned 
a weak learner to strong learner and these types 
of methods have helped to boost prediction power. 
These boosting algorithm which are present works 
based on initially builds a model which are required 
for the dataset and then to correct the faults which 
are developed at initial stage. 
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This technique is performed again and again until 
it has been reduced to a minimum and the dataset 
has been correctly forecasted. AdaBoost, which is 
known as Adaptive booster, is a type of Machine 
Learning method that is used as part of an Ensemble 
Method. Decision trees which contain only one leaf, 
or Decision trees which contain only one split, these 
are one of the popular methods which can be called 
as algorithm which are used in AdaBoost. Other 
names of these trees are called Decision Stumps. 


weakness 


weakness “weakness 


FIGURE 7. AdaBoostAlgorithm 


We are completed the job using the above algo- 
rithm. The 1-9 key pads were produced using opens. 
The automatic movement of the cursor is also vis- 
ible in this keypad. The registered user can enter 
the password by blinking his eyelids. If a person’s 
password matches the database, he can proceed with 
the transaction or any other procedure. Keypad and 
password enter is explained in Figure 8. 


FIGURE 8. Password entry by blinking eye 


5. Results 


The vast amount of information which was collected 
to perform test the machine’s accuracy, and every 
operation performed were executed well. The Pro- 
posed Work flow full implementation is depicted in 
Figure 1. Without manually entering the PIN, the 
password can be verified. Shoulder-surfing, ther- 
mal hacking and other threats to the user are avoided 
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TABLE 1. Performance parameter of gaze based 
detection and eye blinking system 


Performed in Performance 
gaze based _ using eye 
detection blinking 
system 

Efficiency Low effi- High efficient 
ciency 

Availability Person facing Most of all 
problem is could _ easily 
eye have some handle it 
issues 

Duration It takes few It could handle 
minutes to in seconds 
handle 

Expenses More Expen- Cost Efficient 
sive 

Execution It is hard to Very simple to 
execute execute 


with this strategy. This is the most secure method of 
PIN authentication. 

The difference between them easily tells us that 
the eye blinking method of password authentication 
is clearly dominant than the other method present. 
This model was tested on a large number of cases 
with the conditions "PASSWORD MATCH” and 
*PASSWORD NOT MATCH” and others, and all 
of the cases were more than 90% efficient. It is 
one of the different technologies which has not yet 
used until present days and it could replace the phys- 
ical entry of PIN which used in present technology, 
which can lead to risks such as shoulder-surfing, 
thermal hacking, and so on. The objective of this 
system is that there is nothing required implement- 
ing different product to design, therefore even the 
system’s design can be an empty background. 


6. Conclusion 


The main aim of our Paper provide three layers of 
security in which the algorithm which detect the 
face of individual face and produce user identifi- 
cation number and also the name have been gener- 
ated. In second layer person should enter the pass- 
word by blinking his eyes as to avoid from shoulder 
surface or thermal surface attack. Then at last our 
project will generate a automatic one time password 
to registered number and by passing all of these our 
project has provide one the best and secure protec- 
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tion have been provided. This strategy overcomes 
the main disadvantage of forgetting your passwords 
and allowing them to be leaked, and it is the safest 
alternative for the same. The application of this 
technology will benefit every sector of the business 
world. By developing some further modifications 
and conducting more study at a higher level, this 
technology can be employed for high-end security 
systems. 
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